Live freelance tracking. Raw descriptions turned into structured data. Find your next tech project without the noise.
freelancer.com π‘ 2026-05-14
πΉ Web Scraping for Indexed URL Collection and Organization
π€ Client: πΊπΈ Pittsburgh, United States Member since 2026-01-22
π° Price: $45 Average bid
π© Problem: Collect and organize indexed URLs from major search engines.
π¦ Existing: Not specified
Specifications:
[Target] Google, Bing, Yandex indexed URLs
[Method] Keyword-based search using provided keywords
[UI/UX] Not applicable
[Stack] Python (BeautifulSoup, Selenium), API integrations for search engines
[Security] Basic authentication if required by search engine APIs
[Format] Spreadsheet with URL categories
Workflow:
1. Define search parameters and keywords.
2. Use search operators to query Google, Bing, and Yandex.
3. Extract image/video/gallery source URLs.
4. Collect thumbnail URLs separately.
5. Organize URLs into a spreadsheet with categories (e.g., images, videos).
6. Mark duplicate/mirror sources.